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(1) The original image. 
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(3) Result from pixel transfer filter. 
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(5) Result from 3x3 Laplacian filter. 



(2) Result from contrast enhancement. 




(6) Result from 3x3 Gaussian filter followed by max 
Kirsch filter, binarization, and morphological erosion. 
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FIG. 101 



(l)45°-edges. (2) 225°-edges. 




(6) Normalized distribution of 13573 15°-edges in blocks (from top-left to bottom-right). 
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Configuration 


OppnriAnt 
vy \s w u l> cu 1 1 


Child Restraint 


i^igniing \^/(jnuiuon 


■Seat track position 
■Seatback recline 
position 

■Other interior fixture 
configurations (such 
console, glove box, 
seatbelt, etc.) 


■Height 
■Weight 
■Clothing 

■Hair and facial hair 
■Skin tone 
■Seating position 
■Personal objects 


■NHTSA FMVSS208 
approved 1 1 rear-facing 
child restraints, 7 
forward-facing child 
restraints, and 4 booster 
seats. 


■Nighttime condition 
■Sunlight at different time of 1 
the day and/or different 
vehicle orientation 
■Dome light 
■Door light 

■Headlight from other vehicle 
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Feature Extraction 








Adult Neural Network 
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Adult 
Passenger 



Child or Forward- 
Facing Child 
Restraint 



(1) Architecture #1. 












Infant Neural Network 




Adult Neural Network 











Empty-Seat 



Infant Carrier or 
Rearward Facing 
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Adult 
Passenger 




Child or Forward- 
Facing Child 
Restraint 




Undetermined 



(2) Architecture #2. 
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■Generic digital filter 
■Kalman filter 
■Median filter 
■ATI 's post-decision 
filter 
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FIG. 109 



Empty-Seat State 


The system starts from Empty-Seat State, and returns to Empty-Seat 
State every time when the incoming classification becomes empty -seat. 


iransition Mate 


ine system is allowed to cnange ciassincation treely in transition State. 


Revoking State 


Classification change is more restricted in Revoking State. The system 
is allowed to change classification only if the new classification lasts 
longer than the old one. 


Classified State 


In classified State, classification change is either prohibited, or allowed 
only after the new classification has lasted for a very very long time. 
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Path #1 


The system moves from Empty-Seat State to Transition State if the incoming I 
classification is not empty-seat. The system moves from Transition State to j 
Empty-Seat State if the incoming classification becomes empty -seat. f 


Path #2 


The system moves from Transition State to Revoking State if the incoming 
classification lasts more than certain amount of time (7^) without toggling. 


Path #3 


The system moves from Revoking State to Empty-Seat State if the incoming \ 
classification becomes empty-seat. 


Path #4 


The system moves from Revoking State to Classified State if the incoming 
classification lasts more than certain amount of time (T 2 ) without toggling. j 
Usually T 2 »T V 


Path #5 


The system moves from Classified State to Empty -Seat State if the incoming j 
classification becomes empty -seat. 
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Empty-Seat Network 


Infant Network 


Adult Network 
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Hardware System #1 



Analog CMOS Camera from 
Marshall Electronics 
and Image Acquisition Board from 
Foresight Imaging 



I 



Driver from Foresight Imaging 



I 



Application Driver #1 
(Server) 



; Hardware System #2 



USB Digital CMOS 
Camera from OmniVision 



Driver from OmniVision and 
Microsoft 
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Application Driver #2 
(Server) 
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